Search results for "sonic interaction design"

showing 10 items of 17 documents

Multisensory texture exploration at the tip of the pen

2016

A tool for the multisensory stylus-based exploration of virtual textures was used to investigate how different feedback modalities (static or dynamically deformed images, vibration, sound) affect exploratory gestures. To this end, we ran an experiment where participants had to steer a path with the stylus through a curved corridor on the surface of a graphic tablet/display, and we measured steering time, dispersion of trajectories, and applied force. Despite the variety of subjective impressions elicited by the different feedback conditions, we found that only nonvisual feedback induced significant variations in trajectories and an increase in movement time. In a post-experiment, using a pa…

3304Computer scienceRealization (linguistics)ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISIONHuman Factors and ErgonomicsMultisensory Textures02 engineering and technologyTexture (music)Multisensory textureEducationEngineering (all)Sonic Interaction DesignSonic interaction design0202 electrical engineering electronic engineering information engineeringComputer visionEngineering(all)Pen-based interaction; Pseudo-haptics; Multisensory textures; Sonic interaction designPseudo-hapticComputingMethodologies_COMPUTERGRAPHICSSettore ING-INF/05 - Sistemi Di Elaborazione Delle InformazioniSettore INF/01 - Informaticabusiness.industryMovement (music)Work (physics)General Engineering020207 software engineeringMultisensory textures; Pen-based interaction; Pseudo-haptics; Sonic interaction design; Human Factors and Ergonomics; Software; 3304; Engineering (all); Human-Computer Interaction; Hardware and ArchitectureHuman Factors and ErgonomicPseudo-hapticsHuman-Computer InteractionPen-based InteractionHardware and Architecture020201 artificial intelligence & image processingArtificial intelligencebusinessStylusSoftwareGraphics tabletGesture
researchProduct

Sonic Interaction Design

2009

Sound is an integral part of every user experience but a neglected medium in design disciplines. Design of an artifact's sonic qualities is often limited to the shaping of functional, representational, and signaling roles of sound. The interdisciplinary field of sonic interaction design (SID) challenges these prevalent approaches by considering sound as an active medium that can enable novel sensory and social experiences through interactive technologies. This book offers an overview of the emerging SID research, discussing theories, methods, and practices, with a focus on the multisensory aspects of sonic experience. Sonic Interaction Design gathers contributions from scholars, artists, an…

Computer scienceHuman Factors and Ergonomics02 engineering and technologysonic interaction designEducationVisual artsUser experience designElectronic musicHuman–computer interactionSituatedSonic interaction design0202 electrical engineering electronic engineering information engineering0501 psychology and cognitive sciences050107 human factorsInterdisciplinaritySettore INF/01 - Informaticabusiness.industryField (Bourdieu)05 social sciencesGeneral Engineering020207 software engineeringMobile musicHuman-Computer InteractionHardware and ArchitecturebusinessSoftwareInternational Journal of Human-Computer Studies
researchProduct

Design and evaluation of prosody-based non-speech audio feedback for physical training application

2011

Abstract Methodological support for the design of non-speech user interface sounds for human–computer interaction is still fairly scarce. To meet this challenge, this paper presents a sound design case which, as a practical design solution for a wrist-computer physical training application, outlines a prosody-based method for designing non-speech user interface sounds. The principles used in the design are based on nonverbal communicative functions of prosody in speech acts, exemplifying an interpersonal approach to sonic interaction design. The stages of the design process are justified with a theoretical analysis and three empirical sub-studies, which comprise production and recognition t…

Computer scienceSound designHuman Factors and ErgonomicsInterpersonal communicationInteraction designcomputer.software_genreEducationNonverbal communicationUser experience designSonic interaction designta616Prosodyta113business.industryGeneral EngineeringHuman-Computer InteractionHardware and ArchitectureDesign processAudio feedbackArtificial intelligenceUser interfacebusinessEngineering design processcomputerSoftwareNatural language processingInternational Journal of Human-Computer Studies
researchProduct

Non-speech voice for sonic interaction: a catalogue

2016

This paper surveys the uses of non-speech voice as an interaction modality within sonic applications. Three main contexts of use have been identified: sound retrieval, sound synthesis and control, and sound design. An overview of different choices and techniques regarding the style of interaction, the selection of vocal features and their mapping to sound features or controls is here displayed. A comprehensive collection of examples instantiates the use of non-speech voice in actual tools for sonic interaction. It is pointed out that while voice-based techniques are already being used proficiently in sound retrieval and sound synthesis, their use in sound design is still at an exploratory p…

Computer scienceVoice - Sonic interaction - Information retrieval - Sound synthesis - Sound designSpeech recognitionSound design02 engineering and technologyExploratory phase020204 information systemsSonic interaction design0202 electrical engineering electronic engineering information engineeringSelection (linguistics)Information retrieval0501 psychology and cognitive sciences050107 human factorsSound (geography)Sonic interactiongeographyModality (human–computer interaction)geography.geographical_feature_categoryInformation retrieval; Sonic interaction; Sound design; Sound synthesis; Voice; Signal Processing; Human-Computer InteractionSettore INF/01 - Informatica05 social sciencesSound synthesiSound designHuman-Computer InteractionSignal ProcessingVoice
researchProduct

Embodied sound design

2018

Abstract Embodied sound design is a process of sound creation that involves the designer’s vocal apparatus and gestures. The possibilities of vocal sketching were investigated by means of an art installation. An artist–designer interpreted several vocal self-portraits and rendered the corresponding synthetic sketches by using physics-based and concatenative sound synthesis. Both synthesis techniques afforded a broad range of artificial sound objects, from concrete to abstract, all derived from natural vocalisations. The vocal-to-synthetic transformation process was then automated in SEeD, a tool allowing to set and play interactively with physics- or corpus-based sound models. The voice-dri…

Range (music)sound synthesisProcess (engineering)Sound designHuman Factors and Ergonomicsvocal sketchingsonic interaction design01 natural sciences050105 experimental psychologyEducationHuman–computer interaction0103 physical sciencesSettore ICAR/13 - Disegno IndustrialeNatural (music)0501 psychology and cognitive sciencesSet (psychology)010301 acousticsSound (geography)embodimentSettore ING-INF/05 - Sistemi Di Elaborazione Delle Informazionigeographygeography.geographical_feature_categorySettore INF/01 - Informatica05 social sciencesGeneral EngineeringSound designHuman-Computer InteractionHardware and ArchitectureEmbodied cognitionSound design; embodiment; vocal sketching; sound synthesisSoftwareGesture
researchProduct

A Case of Cooperative Sound Design

2016

In this design case study, protocol and linkographic analysis are applied to a task of cooperative vocal sketching, proposed in the scope of educational research activities. The understanding of the cognitive behaviors involved in sound creation is aimed at setting the ground for the development of rigorous, designerly evaluation practices tailored to sound design, all the way to the final interactive product. Relevant qualitative and quantitative information about the creative process informs the assessment and possibly improvement of sound design methods.

Settore INF/01 - InformaticaScope (project management)Computer scienceProcess (engineering)4. EducationSound design05 social sciences020207 software engineering02 engineering and technologyProduct sound designTask (project management)Design cognitionEducational researchDesign theoryHuman–computer interactionSonic interaction designSettore ICAR/13 - Disegno Industriale0202 electrical engineering electronic engineering information engineeringDesigntheory0501 psychology and cognitive sciencesSonic interaction designProtocol (object-oriented programming)Vocal sketching050107 human factorsProceedings of the 9th Nordic Conference on Human-Computer Interaction
researchProduct

Sonic in(tro)spection by vocal sketching

2016

How can the art practice of self-representation be ported to sonic arts? In S’i’ fosse suono, brief sonic self-portraits are arranged in the form of an audiovisual checkerboard. The recorded non-verbal vocal sounds were used as sketches for synthetic renderings, using two seemingly distant sound modeling techniques. Through this piece, the authors elaborate on the ideas of self-portrait, vocal sketching, and sketching in sound design. The artistic exploration gives insights on how vocal utterances may be automatically converted to synthetic sounds, and ultimately how designers may effectively sketch in the domain of sound.

Settore INF/01 - InformaticaSettore ICAR/13 - Disegno Industrialesonic interaction design
researchProduct

Bauhaus Legacy in Research through Design: The Case of Basic Sonic Interaction Design

2014

Settore INF/01 - InformaticaSonic Interaction Designprocedural audiobasic designsonic interaction design; basic design; procedural audio
researchProduct

Interaction by ear

2019

Abstract Speech-based interaction is now part of our everyday experiences, in the home and on the move. More subtle is the presence of designed non-speech sounds in human-machine interactions, and far less evident is their importance to create aural affordances and to support human actions. However, new application areas for interactive sound, beyond the domains of speech and music, have been emerging. These range from tele-operation and way-finding, to peripheral process monitoring and augmented environments. Beyond signalling location, presence, and states, future sounding artifacts are expected to be plastic and reconfigurable, and take into account the inherently egocentric nature of so…

Settore ING-INF/05 - Sistemi Di Elaborazione Delle InformazioniAuditory displaySonificationSettore INF/01 - InformaticaSonic information designProcess (engineering)Computer scienceGeneral EngineeringRepresentation (systemics)Human Factors and ErgonomicsInteraction designSonic interaction design Sonic information design Sonification Auditory displayEducationHuman-Computer InteractionHardware and ArchitectureHuman–computer interactionSonic interaction designAffordanceSoftware
researchProduct

The Sound Design Toolkit

2017

The Sound Design Toolkit is a collection of physically informed sound synthesis models, specifically designed for practice and research in Sonic Interaction Design. The collection is based on a hierarchical, perceptually founded taxonomy of everyday sound events, and implemented by procedural audio algorithms which emphasize the role of sound as a process rather than a product. The models are intuitive to control – and the resulting sounds easy to predict – as they rely on basic everyday listening experience. Physical descriptions of sound events are intentionally simplified to emphasize the most perceptually relevant timbral features, and to reduce computational requirements as well. Keywo…

Settore ING-INF/05 - Sistemi Di Elaborazione Delle Informazionilcsh:Computer softwaresound synthesisound synthesisSettore INF/01 - InformaticaComputer scienceSound designSpeech recognition05 social sciences020207 software engineering02 engineering and technologysonic interaction design050105 experimental psychologyComputer Science ApplicationsSonic interaction design; sound synthesis; procedural audiolcsh:QA76.75-76.765Human–computer interactionSonic interaction design0202 electrical engineering electronic engineering information engineeringprocedural audio0501 psychology and cognitive sciencesActive listeningsonic interaction design; sound synthesis; procedural audioSoftware
researchProduct